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ABSTRACT 

The  problem  of  aiming  control  is  formulated  as  the  problem  of  residence  time 
controllability  in  dynamical  systems  with  stochastic  perturbations.  The  solution  is 
given  for  linear  systems  with  small,  additive,  white  noise  perturbation.  It  is  shown 
that  the  existence  of  the  desired  aiming  controller  depends  on  die  relationship  between 
the  column  spaces  of  the  control  and  noise  matrices.  If  the  former  includes  the  latter, 
any  precision  of  aiming  is  possible.  If  this  inclusion  does  not  occur,  the  precision  is 
bounded,  and  we  give  lower  and  upper  estimates  of  this  bound.  For  each  of  these 
cases,  aiming  controller  design  techniques  are  suggested  and  illustrative  examples  are 
considered.  The  development  is  based  on  an  asymptotic  version  of  the  large  devia¬ 
tions  theory. 
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F49620-87-C-0079.  The  United  Stales  Government  is  authorized  to  reproduce  and  distribute  reprints 
for  governmental  purposes  notwithstanding  any  copyright  notations  hereon. 


L  THE  PROBLEM 


Given  a  controlled  dynamical  system  with  states  x(t)  e/Rn ,  control  u(t)  e/Rm 
and  disturbances  §(t)  eIRr ,  we  define  the  aiming  process  specifications  as  a  pair 
|ft,x)  where  ft  c IRn  is  the  domain  to  which  the  states  x(t)  should  be  confined  and  x 
is  the  period  of  die  confinement,  i.e.,  x(t )  e  ft,  V  t  €  [fo^o+x],  lo  eZR+. 

For  example,  in  the  problem  of  telescope  pointing  [1],  the  domain  ft  is  defined 
by  the  size  of  the  film  grain,  and  x  is  defined  by  the  time  of  the  exposure.  In  the  laser 
beam  pointing  problem  [2],  ft  is  defined  by  die  cross-section  of  the  beam  and  die  size 
of  the  target,  whereas  X  is  defined  by  the  duration  of  the  pulse.  In  the  gun  pointing 
problem  [3],  ft  is  defined  by  the  size  of  the  target  and  the  power  of  the  explosives, 
whereas  x  is  defined  by  the  incidence  time,  Le.,  time  during  which  the  shell  travels  in 
the  barrel.  In  the  robot  arm  pointing  problem  [4],  ft  is  defined  by  the  relative  sizes  of 
the  gripper  and  the  object  to  be  manipulated,  and  x  is  defined  by  the  duration  of  die 
task.  In  the  aircraft  landing  problem  [5],  ft  is  defined  by  the  parameters  of  the  air¬ 
craft  and  the  touchdown  area,  whereas  x  is  defined  by  the  landing  period.  In  the  mis¬ 
sile  terminal  guidance  problem  [6],  ft  is  defined  by  the  domain  to  which  the  line  of 
sight  rate  should  be  confined,  and  x  is  the  period  of  the  intercept. 

Given  a  pair  {ft.t},  the  problem  of  aiming  control  is  formulated  as  the  problem 
of  choosing  a  feedback  control  law,  so  as  to  force  the  states  x  to  remain,  at  least  on 
the  average,  in  ft  during  period  x,  in  spite  of  the  disturbances  %{t)  that  are  acting  on 
the  system. 
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Modem  control  theory  does  not  offer  tools  for  a  direct  solution  of  this  problem. 
Indirect  approaches,  such  as  pole  placement,  LQG  design,  covariance  control,  H  2  and 
Hm  minimization  techniques  do  not  seem  to  give  explicit  relationships  with  the 
residence  time.  Therefore,  given  a  relative  importance  of  pointing  problems  in  modem 
technology,  die  development  of  a  control  theory  for  aiming  processes  seems  desirable. 

In  this  paper  such  a  theory  is  developed  for  linear  systems  with  small,  additive, 
stochastic  perturbations  under  the  assumption  that  all  states  are  available  for  control 
and  the  control  law  is  of  the  form  u  »  Kx.  Results  on  output  feedback  will  be  con¬ 
sidered  in  the  sequel. 

The  approach  developed  in  this  paper  is  based  on  the  first  passage  time  theory  for 
dynamical  systems  with  random  perturbations.  Although  the  fundamentals  of  this 
theory  have  been  known  for  a  long  time  [7],  only  in  recent  years  a  powerful,  construc¬ 
tive,  asymptotic  technique  for  residence  time  evaluation  has  been  developed  [8],  [9]. 
However,  with  die  exception  of  [10]  and  [11]  where  the  stochastic  stability  problem 
was  addressed,  no  control-theoretic  properties  of  the  residence  time  have  been  investi¬ 
gated,  and  no  applications  to  controller  design  have  been  reported. 

In  die  present  paper,  we  apply  the  ideas  and  results  of  [7]-[9]  to  analysis  of  con¬ 
trollability  properties  of  the  residence  time.  Specifically,  we  show  that  the  existence  of 
the  desired  aiming  controller  depends  on  the  relationship  between  the  column  spaces 
of  the  control  and  noise  matrices.  If  the  former  includes  the  latter,  any  precision  of 
aiming  is  possible  (strong  residence  time  controllability  case).  If  this  inclusion  does 
not  occur,  the  achievable  precision  is  always  bounded,  and  we  give  lower  and  upper 
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estimates  of  this  bound  (weak  residence  time  controllability  case).  For  each,  strong 
and  weak  residence  time  controllability,  we  give  design  techniques  for  aiming  controll¬ 
ers.  These  techniques  have  a  peculiarity  that  they  may  result  in  closed  loop  poles 
approaching  the  imaginary  axis  to  ensure  the  largest  possible  residence  time.  This 
counter-intuitive  behavior  is  explained  on  the  basis  of  stable  pole-zero  cancellations  in 
an  auxiliary  transfer  matrix  that  characterizes  the  effect  of  the  noise  and  its  derivatives 
on  the  residence  time. 

The  structure  of  the  paper  is  as  follows:  in  Section  II  mathematical  preliminaries 
are  presented,  in  Section  HI  controllability  properties  of  the  residence  time  are 
described.  Sections  IV  and  V  are  devoted  to  aiming  controller  designs,  and  in  Section 
VI  conclusions  are  formulated;  the  proofs  are  given  in  Appendices  1-3. 

II.  PRELIMINARIES 

Although  the  control  technique  discussed  in  this  paper  is  presented  for  linear  sys¬ 
tems,  the  mathematical  theory  on  which  it  is  based  applies  to  nonlinear  systems  as 
well.  Since  this  theory  is  not  widely  known  within  the  control  community,  we  will 
review  it  briefly  as  it  applies  to  nonlinear  systems  and  then  prove  some  new  results 
that  will  be  used  in  the  subsequent  sections. 

Let  Q  <zIRn  be  a  bounded  domain  containing  jc  *  0  in  its  interior  and  let  dft  be 
its  boundary,  which  is  assumed  to  be  smooth.  Consider  the  following  stochastic 
differential  equation 


dx  =  f(x)dt  +to(x)dw  ,  x(0)«jroc  ft  , 


(2.1) 


<  ■ «] 
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where  x  eZR",  /  :  ZRn  ->ZR",  <J  :  ZR*  -*IRn*r ,  0  <  €  «  1  and  w  eZRr  is  an  r- 
dimensional  standard  Brownian  motion.  Assume  /  (•)  and  o()  satisfy  the  Lipschitz 
and  growth  conditions  [12]: 

H/UWOOII  +  llc(x)-o(y)ll  <S*llx-yll  ,  x,y  eZR*  , 
ll/(x)ll  +  llo(x)ll  £*(l+llxll)  ,  x ,y  eIRn  . 

Then  the  solution,  x(r),  of  (2.1)  is  well  defined  and  is  a  Markov  process  on  ZR*  with 
the  following  infinitesimal  generator  [9]: 

L  =  £/,(*)-4  +S2  £*«/<* ’  (2.2) 

i-l  dxi  ijm  1  OXjdXj 


aij(*)s  ~2  WxWx)T)ij 


Assume  that  0  is  an  asymptotically  stable  equilibrium  point  of  x  =  /(x)  in  12, 
and  assume  that  12  contains  no  other  (O-limit  sets  of  x  =  /(x).  It  is  indicated  in  [7] 
that  if  o(0)  *  0,  then  x(r)  leaves  Q  in  finite  time  with  probability  one  for  all  x0  €  12. 
The  mean  of  the  first  time  of  exit  of  x(r)  from  12,  i.e., 

Te(x0)  *  £[inf{/  :  x(r)  e  912)  lx(0)  =  x0  6  12]  , 
is  shown  in  [7]-[9]  to  satisfy  the  following  boundary  value  problem 

LT*(x0)  =  -  1  ,  x0  6  12  , 

.  .  (2.3) 

Te(x0)  =  0  ,  x0  6  912  . 

In  general  it  is  difficult,  or  impossible,  to  find  an  exact  solution  of  (2.3).  How¬ 
ever,  for  sufficiently  small  e,  asymptotic  solution  methods  have  been  developed  (see 
[8]>[9]).  These  methods  not  only  give  an  approximate  value  of  ?e(x0)  but  also  show 

that,  roughly  speaking,  T*(x0)  *  t  *  *  const  for  all  x0  in  12  outside  of  a  boundary  layer 
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around  9ft.  The  value  of  t e  is  referred  to  as  the  residence  time  in  ft.  More  precise 
statements  in  this  regard  are  given  below. 

Assume  that  /  (x )  and  o(x )  are  twice  continuously  differentiable  in  ft.  Further¬ 
more,  assume  that  fix)  and  o(x)  satisfy  the  following  conditions: 

(i)  For  some  constant  a  >  0, 


X  4y€x)ftjLy  ^  ,X  €  a  . 

i,jrn  1  1=1 

(ii)  If  x  =  f(x),  x(0)  €  ft,  then  x(t)  — »  0  as  /-*».  Furthermore,  the  Jacobian  of 
f  (x)  at  x  =  0  is  Hurwitz. 

(iii)  If  n(x)  is  the  outward  normal  of  9ft,  then  fT(x)n{x)  <  0  for  all  x  e  9ft. 

Conditions  (ii)  and  (iii)  imply  that  ft  is  an  invariant  set  of  x  =  /(x)  with  the 
maximal  co-limit  set  {x  =  0). 


Assume  that  the  first  order  partial  differential  equation 


(2.4) 


m  =  o , 

has  a  strictly  positive  definite  solution  in  ft  (the  closure  of  ft)  and  define  the  loga¬ 
rithmic  residence  time  in  ft  by 


4>(ft)  =  inf$(*)  • 

xcdQ 


(2.5) 


The  following  theorem  was  proven  in  [9]. 


Theorem  2.1:  Assume  that  (i)  •  (iii)  hold.  Then 


lim  e2lnt  \  :0)  =  $(&)  (2.6) 

e-»0 

uniformly  on  compact  subsets  of  Cl. 

Theorem  2.1  states,  in  particular,  that 

teUo>  =  C(£)**Qye*(  1  +  o(D)  as  e  ->  0  . 

A 

If  a  more  precise  estimate  of  x \xq)  than  the  logarithmic  residence  time,  tyCl), 
given  by  Theorem  2.1  is  desired,  the  preexponential  factor  C  (£)  can  be  obtained  using 
the  methods  of  [8}.  Indeed,  let  r(jc)  be  the  solution  to  the  equation 


Xb,(x)  -r-  +  c(x)z  =  0  , 
i=l  °xi 

2(0)  =1  , 


where 


bfU)  =  -2  t  ai}{x)  -fi(x)  , 
y«l 

c(x)  =  -  I  ”2I  37  £ 

«.;«1  dXidXj  j  jml  dXj  dXj 

Then  it  can  be  proven  [13]  that  C  (£)  satisfies 


f  Vi 

"  si  a* 


C(£)  = 


-  |e"^x)/eJz(x)dx 
_ a _ 

J  *(♦-#■*  ))/«22  (jc  X/  r  (jc  )/i  (jc )  ViS* 

& 


(1  +  o(D)  =  Ct(£Kl+  o(l)).  (2.8) 


Since  (2.6)  and  (2.8)  are  asymptotic  in  nature,  it  is  of  interest  to  evaluate  the 

range  of  £’s  for  which  the  constant  x*(Cl)  =  C  i(£)**QyeJ  is  indeed  close  to 
t  e(Xo),  x0  €  Cl.  Although  a  theoretical  (extremely  concervative)  estimate  can  be 
derived,  to  illustrate  the  situation  we  give  here  the  following  example. 


Example  2.1:  Consider  a  scalar  system 


dx  =  f(x)dt  +  zdw  ,  x(0)  =  x0  €  (-1.  D  • 
For  this  system,  (2.3)  becomes  a  two  point  boundary  value  problem 


(2.9) 


f{x)  dx  2  dx2  ’  (  ’  l)  * 


(2.10) 


te(-l)  =  Te(l)  =  0  . 

We  divide  the  analysis  into  two  parts.  First  we  evaluate  qualitively  for  which 
values  of  £  function  Te(x0)  converges  to  a  constant  in  the  interval  (—1,  1)  (excluding  a 
small  boundary  layer),  and  second  we  will  investigate  how  close  this  constant  is  to  the 
one  given  in  Theorem  2.1. 


We  consider  two  cases:  fix)  =  -x  and  fix)  =  -x3.  Even  in  these  simplest  situa¬ 
tions,  it  is  difficult  to  find  an  exact  solution  for  T  e(x0).  Thus  we  solved  the  two  point 
boundary  value  problem  (2.10)  numerically  for  various  values  of  e.  In  Figures  2.1  and 
2.2  the  solutions  arc  plotted  for  several  values  of  6.  As  it  follows  from  these  Figures, 
Te(jto)  is  a  "constant”  in  the  interval  (-1,  1),  if  £  £  1/3  and  £  £  1/4  for  fix)  =  -x 
and  fix)  =  -x3,  respectively. 


To  evaluate  quantitively  the  accuracy  of  the  approximation  given  by  Theorem  2.1, 
we  first  solve  (2.4)  for  / (x )  =  -x  and  fix)  =  -x3  and  calculate  the  logarithmic 

A 

residence  time  (2.5).  A  simple  calculation  shows  that  tyx)  =  x2  and  <j>  =  1  for 
/  (x )  =  -x  and  $(x )  =  x*/2  and  ^  =  1/2  for  fix)  -  -x3.  In  Figures  2.3  and  2.4  we 

A  A 

have  plotted  lit)  =  l(£2  in  Te(0)  -  $)/$!  for  the  two  cases.  As  it  follows  from  these 
Figures,  the  approximation  is  indeed  very  good:  the  maximum  error  is  about  13% 
(£  a  1/3)  and  6%  (£  =  1/4)  for  fix)  *  -x  and  fix)  *  -x3,  respectively. 
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Finally,  we  illustrate  the  calculation  of  C (£).  If  f  (x)  =  -x,  then  :(x)  =  1 .  As  it 
was  shown  in  [8],  the  integrals  appearing  in  (2.8)  can  be  evaluated  by  Laplace  method 


in  the  limit  of  e-»0.  This  gives  (see  [8]  for  details) 

C{ (£)  =  -^-£  (1  +  o(D)  =  C (£)  (1  +  o(l))  • 

Define 


where 


/■(£)  = 


t  e(0)  -  tf(fl) 
tf  (ft) 


(2.11) 


if  (Q)  =  c  (£)  . 

In  Figure  2.5  we  have  plotted  r(£)  as  a  function  of  £  in  the  range  (1/10,  1/3).  It  fol¬ 
lows  from  this  figure  that  tf(ft)  gives  a  very  accurate  estimate  of  Te(0)  in  the  whole 
range,  with  a  maximum  error  of  about  7%  at  £  =  1/3. 


Remark  2.1:  In  a  recent  paper  [14],  a  comparison  of  the  logarithmic  residence 

A 

time  <K&)  with  the  experimental  data,  obtained  by  simulating  a  stochastic  system  large 
number  of  times,  has  been  carried  out.  This  study  revealed  that,  for  the  second  order 
nonlinear  system  under  investigation,  $(Q)  gives  a  very  good  estimate  of  £2  In  Te(0) 
for  even  larger  values  of  £  (£  =  0.6  -  0.8  with  10%  error).  However,  in  the  simula¬ 
tions  reported  in  [14]  the  initial  point  x(Q)  =  x0  was  selected  to  belong  to  a  small 
neighborhood  of  zero  and  no  qualitative  analysis  has  been  carried  out.  Therefore,  the 

A 

results  in  [14]  can  only  be  interpreted  as  how  well  <|Kft)  estimates  the  logarithmic  first 
passage  time  from  0,  i.e.,  £2lnt  £(0),  and  nothing  can  be  inferred  about  the  relationship 
between  $(ft)  and  £2lnt  e(x0)  ,  .t0  e  ft.  For  instance,  in  Figure  2.6  we  have  plotted 
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/(£)  for  f  (x)  -  -x i  in  the  interval  (0.1,  0.8).  It  follows  from  this  figure  that  for 
€  =  0.71 , 4(A)  is  an  estimate  of  e2lnt  e(0)  with  0.4%  accuracy.  However,  for  this 
value  of  £  ,  t  *U0)  is  not  nearly  a  constant  in  the  interval  (-1,  1)  as  is  shown  in  Figure 
2.7  and,  therefore,  the  theory  of  [8],  [9]  is  not  applicable. 

In  the  case  of  linear  systems,  the  results  presented  above  can  be  generalized  in 
two  directions:  first  of  all  equations  (2.4)  and  (2.7)  can  be  solved  explicitly  and, 
secondly  and  more  importantly,  condition  (i)  can  be  weakened  considerably  to  allow 
for  a  larger  class  of  noisy  systems  to  be  considered.  Indeed,  consider  the  equation 

dx  =  Axdt  +  eCdw  (2.12) 

and  assume  that 

(i0  the  pair  (A,C)  is  completely  disturbable,  i.e.,  rank 
[C\AC\  •  •  IA,,-lC]  =  «; 

(ii')  A  is  Hurwitz; 

(in')  if  n(x)  is  the  outward  normal  of  dQ,  then  (Ax)rn( x)  <  0  for  all  jc  €  d£X 
Theorem  2.2:  Assume  that  (i')  and  (ii')  hold.  Then  p(x)  and  z(x)  are  given  by 

♦(*)  =  \xtMx  , 

2  (2.13) 

z(x)  m  1  , 

where  A#  =  X-1  and  X  is  the  unique  positive  definite  solution  to 

AX  +  XAt  +  CCT  =  0  .  (2.14) 


Proof:  See  Appendix  1. 


Theorem  2.3:  Assume  that  (2.12)  satisfies  conditions  (i')-(iii')-  Then  (2.6)  holds 
|  with  $(fl)  defined  by  (2.5)  and  (2.13). 

Proof:  See  Appendix  1. 

The  theory  described  above  constitutes  the  mathematical  foundation  for  the 
residence  time  controllability  analysis  and  the  aiming  control  design  techniques 
presented  in  the  subsequent  sections. 

i 

’  III.  CONTROLLABILITY  OF  THE  RESIDENCE  TIME 

t 

1  m 

Consider  now  a  linear,  stochastic  system  with  control  u  elR  : 

i 

dx  =  (Ax  +  Bu)dt  +  eCdw  ,  x(0)  =  x0  e  Q  .  (3.1) 

Let  u  =  Kx  and  let  x\xqJC)  be  the  mean  first  exit  time  of  the  closed  loop  sys- 

i 

>  tern 

! 

|  dx  -  (A  +  BK)xdt  +  zCdw  ,  x(0)  =  xQ  e  O  ,  (3.2) 

i 

|  from  the  domain  Q. 

I 
| 

Assume  we  want  to  select  the  controller  K  such  that  x\xQrK)  2:  T  for  some 
prescribed  T  >  0  and  all  x0  €  01(  where  is  a  subset  of  O  which  does  not  contain 
any  boundary  points  of  Q. 

A  A 

Consider  the  alternative  problem  of  selecting  4KOX)  >  <t>  where  fyftJC)  is  given 


)(QJC)=  inf  -1  xtM(K)x  , 
xedQ  2 


by 


M(K)(A  +  BK)  +  (A  +  BK)t  M(K)  +  M(K)CCT M(K)  =  0  , 
and  $  >  0  is  some  prescribed  constant.  Then  if  system  (3.2)  satisfies  the  assumptions 

of  Theorem  2.3  we  have 

£2ihre(jroJO  =  +  e(zjCoJK\  x0  €  ft  , 

where  e(£j 0JC)  — >  0  as  £-4  0  uniformly  for  x0  belonging  to  compact  subsets  of  ft. 

A 

Thus,  since  by  the  choice  of  K  we  have  ^{CIJC )  -  <j>  >  0,  there  exists  an  £q  >  0  such 
that  for  all  0  <  £  ^  £q  we  have 

£2lnr \xoJC)  -  +  =  MCIJC) -$  +  e(esoJC)  Z  0 

or  equivalently, 

x\xqJC)  *  ***  *  *** 

for  all  jt0  e  ftp  Therefore,  if  the  noise  intensity,  £,  of  system  (3.2)  is  less  than  £ 0  the 
choice  <|>  =  £2lnT  guarantees  Y*(XqJC)  2  T,  jc0  €  ftp 

Motivated  by  the  above  considerations  we  introduce  the  following  definitions. 

Definition  3.1:  System  (3.1)  is  said  to  be  weakly  residence  time  controllable 
(wit-controllable)  if  for  any  bounded  ft  cZRn ,  with  0  in  its  interior,  there  exists  a  con- 

A 

trol  u  =  Kx  such  that  4»(ft^T)  >  0. 

Definition  3.2:  System  (3.1)  is  said  to  be  strongly  residence  time  controllable 
(srt-controUable)  if  for  any  bounded  ft  <zlRn  (0  €  ft)  and  any  $  >  0  there  exists 
u  -  Kx  such  that  >  4>. 

In  the  remainder  of  the  paper  we  assume  that  system  (3.1)  does  not  contain  any 
modes  that  are  both  uncontrollable  and  undisturbable  (see,  however,  Remark  3.2 


below). 


Theorem  3.1:  System  (3.1)  is  wtt-controllable  if  and  only  if  (A  3 )  is  stabilizable. 
Proof:  See  Appendix  2. 

Theorem  3.2:  System  (3.1)  is  sit-controllable  if  and  only  if  (A3)  is  stabilizable 
and  ImC  £  Imfi. 

Proof:  See  Appendix  2. 

For  any  wit-controllable  system  there  exists  a  maximal  constant  (Cl)  such  that 

A 

any  logarithmic  residence  time  ^(CIJC)  <  ^  (Cl)  is  realizable  by  a  choice  of  K.  The 
constant  (Q),  referred  to  as  maximum  achievable  precision  of  aiming,  can  be  charac¬ 
terized  as  follows:  Let  Qy  be  the  positive  definite  solution  of  the  Ricatti  equation 

ArQy  +  (2y4  +/ ,  y>  0  ,  (3.3) 

and  define  fC1  and  Xy  by 

lC  =  --^BTQy  ,  (3.4) 

(A  +BKr)Xy  +  X^A  +BK?)r  +  CCT  =  0  .  (3.5) 

Let  TcX0  -  limTtYT  (this  limit  exists  since  TrXy  is  nonincreasing  and  bounded  below 

Y~*0 

as  y  -»  0  [15])  and  Xq  *  inf  X^^(XT). 

Theorem  3.3:  Let  r  =  min  IIjc  II,  R  =  max  llx  II,  Xj  =  nl TrX0  and  X2  =  I/Kq. 

x  e  dQ  jredQ 

Then 

X^r2  ±  XJ?2  ~ 

h,(ci)  =  <;**(n)£-y-  =♦„(«)  .  0  6) 
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Proof:  See  Appendix  2. 

Remark  3.1:  To  obtain  the  lower  bound  +/(&),  the  computation  of  Xy  for  a 
sequence  of  y’s  converging  to  zero  is  necessary.  A  simpler  but  more  conservative 
lower  bound  of  (A)  is 


♦n<n>  = 


2Trf0 

Evaluation  of  a  sufficiently  accurate  estimate  of  and  requires  only  the  solution 
of  (3.3),  (3.3)  for  one  small  value  of  y. 

Remark  3.2:  If  system  (3.1)  does  have  modes  that  are  both  uncontrollable  and 
undisturbable,  then  by  a  change  of  coordinates,  x  -  Px,  it  can  be  reduced  to  the  form: 


I  1 

dx2 


* 11  *12 
0  A  22 


*1 

*2 


dt  + 


1*1 

0 


udt  +  £ 


o']*' 


where  the  deterministic  subsystem,  Hj,  =  A 22*2*  contains  the  uncontrollable,  undisturb¬ 
able  part  of  the  system.  In  this  case  we  would  consider  the  aiming  control  problem 
for  the  lower  dimensional  system  (A  nJt\,C  t)  in  the  bounded  domain 
Q(  =  ( \Px  €  Q}  and  for  which  Theorems  3.1  -  3.3  apply. 


IV.  CONTROLLER  DESIGN  A:  SRT-CONTROLLABILITY  CASE 

Consider  again  (3.1)  and  assume  that  either  wrt-  or  srt-controllability  takes  place. 
Then  with  a  control  u0  =  KqX,  which  renders  (3.1)  stable  and  (A  +  BKqJC)  disturb- 
able,  the  logarithmic  residence  time  of  the  closed  loop  system 

dx  *  Atfcit  +  £ Cdw  ,  A0  *  A  +  BK0 
in  a  bounded  domain  Q  <zIRn  is  given  by 


(4.1) 


i<a*o>  =  inf^o(jr)=  inf xtMqX  , 

xedQ  .r€dQ  2 

AZM0  +  M0A0  +  M(£CTM0=0  .  (4.2) 

This  residence  time  can  be  increased  (or,  more  generally,  changed)  by  an 

appropriate  modification  of  K0.  The  modification,  however,  depends  on  whether  srt- 

or  wrt -controllability  takes  place.  In  this  section  the  former  is  addressed. 

Theorem  4.1:  Assume  that  system  (3.1)  is  srt -controllable.  Then  the  control 

ua  =  (K0-2j  HCtM0)x  ±Kax  ,  (4.3) 

where  H  is  given  by  C  =  BH ,  applied  to  (3.1)  results  in  a  logarithmic  residence  time 
in  SI  given  by 

«Sl#a)  =  Kq)  . 

Proof:  Follows  directly  from  the  sufficiency  part  of  the  proof  of  Theorem  3.2. 
From  Theorem  4.1  we  obtain: 

Design  Procedure  4.1:  (i)  Select  K0  such  that  A0  =  A  +  BK0  is  Hurwitz  and 

A 

04 o,C)  is  completely  disturbable.  Calculate  M0  and  ^(SIJC0)  given  by  (4.2). 

( ii )  For  any  desired  logarithmic  residence  time  +  >  0  calculate 

a - »-  . 

kajCot 

With  AT°  =  Kq-  — HCtMq  the  closed  loop  system  dx  »  ( A+BKa)xdt  +  zCdw  has 

A 

logarithmic  residence  time  4(flXa)  = 

It  is  of  interest  to  investigate  the  location  of  the  closed  loop  poles  defined  by 


residence  time  controller  (4.3).  For  this  purpose,  introduce  an  rxr  transfer  matrix 


Go(J )  =  CtM^sI  -  Ao)-lC  (4.4) 

where  M0  is  defined  by  (4.2).  Assume  that  C  has  full  rank  (to  avoid  trivial  situations) 


and  define 

■  <45) 

Let  . zp,  p  <  a,  be  the  zeroes  of  Z(s). 

Theorem  4.2:  As  a  — »  p  closed  loop  poles  of 

dx  =  (A  +  B  (K0  -  ■—  HCTM0))xdt  +  tCdw  (4.6) 

converge  to  zeroes  of  Z(s)  while  the  remaining  n  -  p  poles  converge  to  — «*>. 

Proof:  See  Appendix  3. 

Theorem  4.2  states,  in  particular,  that  a  feedback  which  ensures  a  very  large 
residence  time  may  place  the  closed  loop  poles  arbitrarily  close  to  the  imaginary  axis 
if  Z(s )  has  purely  imaginary  zeroes.  The  explanation  of  this  counter-intuitive 
phenomenon  is  the  following:  Each  zero  of  detGoU)  corresponds  to  a  differentiation 
of  the  external  input,  i.e.,  noise.  The  derivatives  of  white  noise  have  a  very  strong  dis¬ 
turbing  power.  That  is  why  it  is  advantageous  to  place  the  closed  loop  poles  so  that 
the  zeroes  of  Gq(s  )  are  cancelled. 

Example  4.1:  Consider  system  (3.1)  with 

0  10 

0  0  1  ,  B  *C  = 

0  0  0, 

Clearly  (AJi,C)  is  completely  controllable  and  disturbable  and  ImC  =  Imfl .  There¬ 
fore,  conditions  of  Theorems  3.2  and  4.1  are  satisfied  and  a  controller  of  the  form  (4.3) 
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can  be  employed  to  obtain  any  desired  residence  time.  Choosing 


|  tf0=  [-1.-1. -2] 

i 

|  results  in 


!  and 


2  0  2 
0  2  0 
.2  0  4 


Go<s)  «  CtM^s!  -  (A  +  MTo))-1  C 
=  4(l+2f2) 

j3+2j2+r+l 

Therefore,  controller  (4.3)  becomes 


Ka  =  K0-  -Sy1  HCtM o  »[  -  a,  -  1,  -  2a]  . 

By  Theorem  4.2,  as  a  — >  two  of  the  closed  loop  poles  converge  to  the  zeroes  of 
G(£s  )  at  s  *  ±/V2/2,  while  the  third  pole  converges  to  -  ••.  Furthermore, 
+(£  (0,1)/T°)  is  a  linear  function  of  a,  6a  ■  0.382a. 


V.  CONTROLLER  DESIGN  B:  SRT/WRT-CONTROLLABILITY  CASE 


When  ImC  <£  Im£,  the  residence  time  contoller  design  is  not  as  simple  as  in 
Theorem  4.1.  One  possible  approach  is  to  generalize  Design  Procedure  4.1  in  an  itera¬ 
tive  manner.  However,  this  approach  is  inferior  to  the  approach  presented  below  and 
will  not  be  pursued  here.  Our  second  approach  for  the  design  of  an  aiming  controller 
is  based  on  the  Ricani  equation  (3.3).  As  before,  we  select  an  initial  control 
u0  *  KqX  .  Define  a  controller 
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Ui  =  FCfx  =  {K0  -  -  BTQy)x  ,  y  >  0  , 


where  Qy  is  the  positive  definite  solution  of 

AoQy+QlAo  +  1  -  ~yQyBBTQy  =  0  .  (5.2) 

The  logarithmic  residence  time  of  system  (3.1)  with  the  stabilizing  control  (5.1)  in  a 
bounded  Q  cZRn  is  given  by 

#0**)  =  msJxTMf  (5.3) 


where 


(A  +BKT)TMy  +  M+A  +BITt)  +  MfCTMy  =  0  .  (5.4) 

Theorem  5.1:  Assume  (AM )  is  stabilizable.  Then 

(a)  if  ImC  c  ImU ,  then  tfCUf'O  ->  ••  as  y  -»  0; 

(b)  if  ImC  £  Imfl ,  then  sup  +(fl,iP)  lies  between  the  upper  and  lower  bounds 


of  Theorem  3.3. 


Proof:  See  Appendix  3. 

Remark  5.1:  It  follows  from  the  proof  of  Theorem  3.3  that  for  each  y  >  0, 


iiQJC7)  *  - — 

2Trf, 


Furthermore,  is  nondecreasing  as  y  -+  0  and,  thus,  is  a  good  lower  estimate  for 

*1  T A  y 

design  purposes. 


Theorem  5.1  suggests  the  following: 
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Design  Procedure  5.1:  (i)  Select  K0  such  that  (A  +  BKq,C)  is  a  disturbable  pair. 

(ii)  For  a  given  logarithmic  residence  time  0  <  4>  <  $/  (Q)  iteratively  find  a  y  >  0 
such  that  WCIJC*)  t  p. 

Remark  5.2:  The  above  design  procedure  involves  a  solution  of  a  quadratic 
(Ricatti)  matrix  equation.  For  high  order  systems  the  computational  effoit  may  be 
considerable  at  each  iteration.  On  the  other  hand,  the  design  procedure  outlined  in 
Section  IV  involves  only  the  solution  of  one  Liapunov  equation  and,  hence,  the  com¬ 
putational  effort  is  considerably  less. 

The  asymptotic  analysis  as  y  — ►  0  of  the  poles  of  the  closed  loop  system 

dx  =  (A  +  BKr)xdt  +  eCdw  (5.5) 

can  be  carried  out  in  a  similar  manner  as  in  Section  IV.  Indeed,  it  is  shown  in  [15] 
that  as  y  — >  0, 

-i.BTer-»To*o 

Therefore,  a  simple  analysis  of  det (si  -A  -  BfH)  shows  that  the  closed  loop  poles 
that  remain  finite  as  y  -*  0  converge  to  the  zeroes  of  the  m  x  m  transfer  matrix 

G(j)  =  BTQ(sl  -  A0)~XB  (5.6) 

Example  5.1:  Design  Procedure  5.1  (DP5.1)  was  used  to  design  a  controller  for 
the  system  in  Example  4.1.  In  Fig.  5.1  the  logarithmic  residence  times  of  the  result¬ 
ing  closed  loop  systems  are  compared  as  a  function  of  control  effort,  1 1  ATI  I .  The  plots 
reveal  that  DP5.1  results  in  a  larger  residence  time  for  a  given  control  effort  as  com¬ 
pared  with  DP4.1.  However,  bearing  in  mind  that  DP4.1  is  a  one  step  procedure,  it  is 


clear  that  in  many  cases  the  computational  advantage  may  be  considerable. 
It  is  easily  checked  that 


lim -r-BTQy  =  BtQ  =  [0.456,  0.7899,  0.456]  . 

y-*0  vy  J 

Therefore,  as  y  0,  two  of  the  closed  loop  poles  of  system  (5.5)  converge  to  the 
zeroes  of  (5.6), 


G(s)  =  BtQ(sI-Aq)~1B  = 


0.456s  2+0.7899s +0.456 


j3  +  2s2  +  s  +  1 

located  at  s  =-V3/2±/l/2,  while  the  third  pole  converges  to 


There  is  an 


interesting  difference  between  the  two  designs  in  this  respect,  i.e.,  to  approach  an 
infinite  residence  time  DP  4.1  results  in  closed  loop  poles  approaching  the  imaginary 
axis,  whereas  DP  5.1  results  in  poles  that  have  strictly  negative  real  parts. 


Example  5.2:  Consider  the  problem  of  designing  a  roll  attitude  regulator  for  a 
missile  disturbed  by  random  torques.  A  simple  linearized  model  for  the  system  is  [16] 


6 

0 

0 

0 

■fi 

1  ' 

0 

CD 

s 

10 

-l 

0 

CD 

+ 

0 

U  +  € 

1 

9 

.  0 

1 

0  . 

.9  . 

.0  . 

.0  . 

(5.7) 


where  5  is  the  aileron  deflection,  to  is  the  toll  angular  velocity,  6  is  the  roll  angle,  u  is 
a  command  signal  to  aileron  actuators  and  w  is  white  noise. 


Clearly  ImC  £  Im B  and  (AJB)  is  controllable.  Therefore,  system  (5.7)  is  wrt- 
con  troll  able  and  4*  (A)  is  estimated  using  Theorem  3.3  to  satisfy 


5.36r2  £  9*  (ft)  £  15 R2 
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In  [16]  a  covariance  control  approach  was  used  to  design  a  controller  for  (5.7). 
The  design  specifications  were 


-2  121e2  ,  8l£2  _  2<  £2 

'  £<“^7I?o  •  E*  S7I*>  ’ 


and  the  resulting  controller 


u  =  -  14.5655  -  24.43(0  -  68.57*  .  (5.8) 

The  logarithmic  residence  time  of  the  closed  loop  system  with  control  (5.8)  in  the  ball 
B  (0,V2)  is  calculated  to  be  *  =  6.94. 


A  residence  time  controller  was  designed  using  Design  Procedure  5.1  with  a  start¬ 
ing  value  Kq  =  [-  3,  -  6,  -  4].  The  following  results  are  of  importance: 

(a)  A  controller  which  results  in  the  same  logarithmic  residence  time  in  B  (0,^2) 
as  (5.8)  is 


u  -  -  4.9125  -  6.580®  -  4.823*  . 

We  note  that  this  controller  uses  much  less  control  effort  than  (5.8). 


(b)  A  controller  that  uses  about  the  same  control  effort  as  (5.8)  is 
u  =-42.195  -  42.28®  -  40.31*  . 

However,  the  closed  loop  system  with  this  control  has  logarithmic  residence  time  in 
B  (0,^2)  of  *  =  10.19.  The  largest  achievable  logarithmic  residence  time  in  B(  0,V2) 
using  Design  Procedure  5.1  is  exactly  the  lower  bound  of  **  (Q)  calculated  above  with 
r  «  V 2.  When  this  bound  is  approached,  two  closed  loop  poles  of  system  (5.5)  con¬ 
verge  to  zeroes  of 
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£^£+1) 

p(s) 


G(s)  =  BtQ(sI-A0)-'B  =  [0.46  0.46  0.46] 


1  Os 
P(s) 


0.46(r2+llr+10) 

r3+7s2+116s+80 


10 

.  P(*>  . 

located  at  s  =  -1,  -  10,  while  the  third  closed  loop  pole  converges  to  infinity. 


VI.  CONCLUSIONS 

In  this  paper,  a  new  problem  of  aiming  control  is  formulated  and  solved  for  linear 
systems  with  small  additive  white  noise.  A  generalization  for  wide-band  noise 
processes  is  straightforward  (using  the  techniques  of  [17])  and  does  not  change  the 
conclusions  of  this  paper. 

Among  these  conclusions,  the  following  are  of  prime  importance:  The  properties 
of  the  aiming  controllers  strongly  depend  on  the  relationship  between  the  column 
spaces  of  the  control  and  noise  matrices.  If  the  former  includes  the  latter,  any  preci¬ 
sion  of  aiming  is  achievable  and  the  desired  controller  can  be  obtained  in  a  one  step 
procedure.  If  this  inclusion  does  not  occur,  the  achievable  precision  is  limited  and  an 
aiming  controller  is  designed  by  an  iterative  procedure. 

The  main  advantage  of  the  developed  approach  is  that  it  is  based  directly  on  aim¬ 
ing  process  specifications  and  does  not  involve  an  informal  choice  of  any  parameter 
(poles,  weighting  matrices  or  covariances,  for  example). 

The  results  presented  in  this  paper  may  also  be  viewed  from  a  perspective  of  sto¬ 
chastic  system  stability.  Indeed,  stability  in  moments,  probability  or  almost  surely 


IT 
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does  not  exclude  large  deviations  of  the  state  vector  from  the  equilibrium  point. 
Therefore,  controllers  designed  in  this  paper  may  be  viewed  as  mechanisms  for  ensur¬ 
ing  certain  types  of  stochastic  stability  along  with  guaranteeing  a  desired  residence 
time. 
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APPENDIX  I 


Proof  of  Theorem  2.2:  In  this  case  equation  (2.4)  becomes 


T 

Ax  +  - 

»  ' 

dx 

b  4 

2 

dx 

b  4 

CCT  4*  *  0  , 
dx 


(Al.l) 


4K0)  =  0  . 


We  have  to  show  that  <tK*)  given  by  (2.13)  satisfies  (Al.l),  i.e., 

xT(MA  +  1  MCCtM)x  =  0  .  (A1.2) 

Since  (A  ,C)  is  disturbable  and  A  is  Hurwitz,  (2.14)  has  a  unique  positive  definite 
solution  X .  Let  M  -  X~l  and  rewrite  (2.14)  in  terms  of  M 

MA  +  AtM  +  MCCtM  *  0 
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or 

M(A  +-2CCtM)  +  {A  +~2CCtM)tM  =  0  .  (A1.3) 

1  _ 

(A1.3)  shows  that  the  matrix  M(A  +  - CC  W)  is  skew  symmetric  which  in  turn 
implies  that  (A1.2)  holds. 

Next  we  show  that  z(x)  *  1.  Equation  (2.7)  now  becomes 

(CCtMx  +  Ax )T -|Z  +  (-J  Tr(CCrAf )  +  TtA  )r  =  0  .  (A1 .4) 

ox  2 

Let  5  be  a  unitary  transformation  that  diagonalizes  M .  Let  A  =  STAS,  M  -  STMS , 
0  =  STCCTS.  Then  we  have 

0  =  (Af A  +  ArA#  +  MCCtM )  =  (AfA  +  AT M  +  MDM)  . 

This  implies  that  2m„  =  0  ,  i  =  0,  l,  /i .  Therefore 

£(4  +4"»«rf«)  =  0  •  (A  1.5) 

i-1  L 

Equation  (A  1.5)  can  equivalently  be  written  as 

0  =  Tr(A*  +  -  DM)  a  Tr(A  +  -  CCT M) 
which  in  turn  implies  that  (A1.4)  becomes 

(CCtMx  +  Ax)7^  =0  .  (A1.6) 

dx 

Thus,  z(x)  m  1  is  a  solution  to  (A  1.6)  which  satisfies  the  boundary  conditions. 

Q.E.D 

Proof  of  Theorem  2.3:  By  assumptions  (0  and  (ii')  x{t ),  the  solution  to  (2.12), 
has  a  transition  probability  density  [18] 
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Y  €  A  and  such  that  the  distance  from  y  to  y  is  less  than  or  equal  to  6.  Now,  by 
Lemma  4  in  [19]  we  have 


J P(x *s0jy)jP(s,y,Ws)ds  * P{WJz\x 0)  +  0(*-1/e)  ,  (A1.8) 

da  o 

where 


P(WJ  =  Urn  PitJoWJ 
=  jpe(y)dy 


pl(y )  =  g-MyWt* 

P  ^  (2ti£2)"/2(detX)1/2 

where  $(y)  is  given  by  (2.13).  Choose  A  =  dfl,  then  each  ye  d£2  belongs  to 
W  =  W}q  and  therefore 


P{0,y,W)  =  1  . 

Using  assumption  (in'),  the  continuity  of  P  (s  ,y,W )  and  the  exponential  character  of 
pe(t  jc,y)  we  have  for  some  5 >  0 


Therefore, 


P(s,y,W)2  l-e**s  . 


EBS9 


i  A  A 

L  2s2!  ^  i  _  „  2c* 


jp(s,y,W)ds  2  1  -  je  2>  1  -  e 


«i 


This  gives 


f  P  (t  tjc04  Tf)j/>  (s  ,Y ,W  )ds 
do  o 

=  fP( t  Vo^rXi  +  <Xe-l/ei))  *  1  +  0(e-xie)  . 
da 

Here,  we  have  used  the  fact  that  since  t c  is  an  exit-time. 


da 


Then  we  have  from  (A1.8) 


1  -P{Wyx\x0)  +  (Ke-Ve)  . 


Next  we  use  Laplace  method  to  evaluate  P(W)  in  the  limit  as  e  — >  0,  i.e.. 


(A1.9) 


P(W)  =  e-^<QyelC(£)  (1  +  o(D)  as  e  ->  0  ,  (A1.10) 

where  C  (£)  is  a  constant  depending  on  ^ )  and  the  boundary  dfl  Furthermore,  C(E) 

grows  not  faster  than  e~"  as  £  — »  0.  Whence,  (2.6)  follows  directly  from  (A1.9)  and 


L. 


APPENDIX  2 


Proof  of  Theorem  3.1:  For  the  necessity  we  note  that  with  ft  =  5(0,1)  wtt- 
controllability  implies  that  there  exists  a  control  u  -  Kx  such  that 

<|K5(0,1)JO  =  k^iXfiK))  >  0.  Thus,  M(K)>0  and  it  follows  from  a  standard 

Liapunov  theorem  that  ( A+BK )  is  Hurwitz.  To  prove  die  sufficiency  we  first  note  that 
it  follows  from  the  proof  of  Theorem  5  in  [20]  that  there  exists  a  stabilizing  feedback 
u0  =  KqX  such  that  the  closed  loop  system  with  this  control  is  completely  disturbable 
(in  fact,  this  is  true  for  almost  any  stabilizing  feedback  matrix).  Now  the  rest  of  the 
proof  follows  directly  from  Theorem  2.3. 


Q.E.D. 

Proof  of  Theorem  3.2:  We  prove  the  necessity  and  sufficiency  of  the  condition 
ImC  c  ImZ? . 

A 

Necessity:  Let  x  -  Px  be  a  change  of  coordinates  which  maps  system  (3.1)  into 
the  form: 


dx  = 


Atl  A 12 

A  A 

A2i  A 22 


dt  +  e 


(A2.1) 


A  A 

where  B  y  has  full  row  rank.  With  a  stabilizing  control  u  =£r,  the  logarithmic 

A  A  -  A 

residence  time  of  system  (A2.1)  is  determined  by  M  =  X~  where  X  is  the  positive 
definite  solution  of 


A  AAA  AA  A  A  A  A  a, 

(A  +  BKVC  +  X(A  +  BK)t  +  CCT  =  0  .  (A2.2) 

Writing  equation  (A2.2)  in  a  compatible  block  form  with  equation  (A2.1)  results  in  the 
following  equation  for  the  (2,2)  block 
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u 


1  ■ 

V, 

-  M 


>tV 

«■* 


U 


U 


*21^12  +  ^22^22  ■*■  ^22*22  +  ^1*2^21  +^2^2  s® 


From  (A2.3)  we  obtain 


211X12^21  +^22^22^2^  HC2C2  1 1 2  » 


(A2.3) 


(A2.4) 


which  gives 


(A2.5) 


1  *  «  *r  A  21 

-  iic^iij*  II(X[2  X22)H2  II  . 

t*=j 

[IT 

.  *21 

^  itx  ii2ii  n2  . 

*1 2 . 


Finally,  since  MX  ll2  =  X*„(X),  H<?2C|‘  ll2 »  A^CjCj)  and  II  ll2  = 

*22 

+  *22*22  »V2.  wc  «*“*g  (A2.3) 


UCjC[) 


*„«(*)  * 


?(Km(*h*2i  +  *22*22)) 


L  wVi  ’ 


which  in  turn  implies  that  if  C2  #  0, 

,  ^  21* ll+*22*72  »*/2  .  * 

A^njn(Af  )  S  *  «•  *  A» 

Wc2c[) 

Therefore,  the  logarithmic  residence  time  of  systems  (A2.1)  in  a  bounded  ft  is 
bounded  by 

*  «  »2i* 

♦(ft  JO  £  — —  ,  R1  *  max  xTx 

2  xcdQ 

This  completes  the  proof  of  the  necessity. 

Sufficiency:  The  proof  is  by  construction.  Select  a  stabilizing  control  u0  =  Kqk 
such  that  (A  +  BKqJC  )  is  disturbable.  Then  the  closed  loop  system 
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dx  =  (A  +  BK0)xdt  +  eCVAv 

♦ 

i 

s* 

has  a  logarithmic  residence  time  in  a  bounded  O  given  by 

1 

^(QJC0)  =  inf  -  xtMqX  , 
x€dO  ± 

(A2.6) 

(A  +BK(jrM0  +  M^A  +flATo)  +  M<£CTM0  =  0  . 

(A2.7) 

*  1 1 
*  * 

Define  a  feedback  matrix  Ka  by 

V 

Ka  =  K0-  ~  HCtM0,  a  >  0  , 

(A2.8) 

V 

where  H  is  determined  by  the  relationship  C  *  BH .  Then,  if  A  + 

is  Hurwitz, 

.■» 

the  closed  loop  system  has  logarithmic  residence  time  in  Q  determined  by 

» 

, 

(A+BKa? M  +  M(A+BKa )  +  MCCTM  *  0  . 

(A2.9) 

Substituting  (A2.8)  into  (A2.9)  and  rearranging  gives 

(A+BK0fM  +  M(A  +BK0)  +  MCCJM 

.* 

-  MCCtM0  -  -St.1  M<£CrM  *  0  . 

2  2 

(A2.10) 

A  simple  check  shows  that  M  ~  a M0  is  a  positive  definite  solution  of  (A2.10)  which 

V 

i 

in  turn  implies  that  A+BKa  is  Hurwitz.  Thus,  the  logarithmic  residence  time  of  the 

I 

>.  ' 

closed  loop  system  with  control  (A2.8)  is 

t 

(A2.ll) 

4L«i 

A 

Furthermore,  it  follows  from  eq.  (A2.ll)  that  +(SlJCa)  — » <*>  as  a  -*  «». 

Q.E.D. 

'' 

Proof  of  Theorem  3J:  It  follows  from  the  results  of  [IS],  [21]  that  for  each 

y>Q,Ki  defined  by  (3.4)  is  a  stabilizing  control  and  that  for  any  other  stabilizing  K 

L 
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8 


I 

8 


8 

8 

I 


! 

8 

8 

S 


I 


Tr X^I  +  J  QyBBTQr )  S  TrX(ATX/  +  Y*r*>  . 

(A  +BK)X(K)  +X{KXA+BK)t  +  CCr  =  0  . 

Furthermore,  it  is  shown  in  [15]  that  TrX^  is  a  nonincreasing  function  of  y  as  y 
and 


limTrJty/  +  -  QyBBTQy)  *  limTr^T  =  Tr*0  . 
iHJ  Y  y—tO 


Therefore,  for  all  stabilizing  K, 


Define 


TrX0  £  TrX(10 


(A2.12) 


Kr,.,(X )  *  inf  ^A»...(X(1C))  I  A  +BAT  is  Hurwitz  J  ,  (A2.13) 

A 

and  note  that,  by  the  proof  of  Theorem  3.2,  A _ (X )  >  0  when  ImC  £  Imfl .  There¬ 

fore,  (A2.13)  gives 


and  from  (A2.12)  we  have 


0  <*»«(*)  . 


TrXoSTrX  Znl^X)  . 


(A2.14) 


(A2.15) 


The  residence  time  in  Q  for  system  (3.1)  with  a  stabilizing  K  is  determined  by 

W*)  *  inf  \xtM(K)x  , 

jrcdQ  2 


Therefore, 


(A+BK)tM(K)  +  M(K)(A+BK)  +  M{K)CCTM(K)  -  0  . 


*OJC)  *  \  UM(^))  iirf  xrjc  *  -!  X^CMtfDV2  , 

2  x«dQ  2 


and,  using  (A2.14), 


(A2.16) 


r2  ^  ^r% 

2Awm(X)  2Xo  *  2 


Similarly,  (A2.1S)  gives 


^  R2  „  nR 2  R\ 
Finally,  (3.6)  follows  from  the  bounds  (A2.16)  and  (A2.17). 


(A2.17) 


Q.E.D. 


APPENDIX  3 


Proof  of  Theorem  4.2:  The  characteristic  equation  of  the  closed  loop  system 


(4.6)  is 


det(X/,  -  A0  +  BHCtM<$  *  0 


(A3.1) 


1  a— 1 

To  simplify  notation  let  -  =  — —  and  BH  =  C.  Then  (A3.1)  can  rewritten  as  fol- 

Y  2 


0  =  det(X/„  -  A0  +  -^CCtM0) 

=  det 0JH  -Ao)det(/„  +  lcCTM<f)JH-A0rl) 

=  det(X/n  -  A  0)det(/r  +  -  CrM0(X/w-A0)-lC) 

Y 

=  (-‘  )rdet(X/„  -  A0)det(y/r  +  Gq(X))  . 


(A3.2) 


When  y  —*  0  (Le.,  a  —»<*>),  p  of  the  roots  of  (A3. 2)  converge  to  the  zeroes  of 

0  =  det (X/„  -  /4„)detGo(X)  =  Z(X) 

(for  a  proof  see  e.g.  [22])  and  the  remaining  n  -  p  roots  converge  to  infinity. 


K 

f 

|  Q.E.D. 

Proof  of  Theorem  5.1:  To  prove  statement  (a)  of  the  theorem  assume,  without 


loss  of  generality,  that  B  has  the  form 


1 

I 

I 

8 

8 


B  » 


(A3 .3) 


where  B  t  has  full  row  rank.  Let  lim  Qy  *  Q0  (this  limn  exists  because  Qy  is  a  nonin- 

y-»0  '  ' 

creasing  function  of  y  as  y  ->  0  [15]).  Then  Q0  satisfies  [23] 

Afco  +  Q<A  o  ♦ 1  -  U"*-1  QyBBTQy  -  0  .  (A3.4) 

y-tO  y 

The  last  term  in  (A3.4)  when  rewritten  in  a  compatible  Mock  form  with  (A3.3)  is 


I 

8 

R 


Um-'e/*rGr 
r-*o  y  f  ' 


st  lim  - 

r-*o  y 


cr“*i«[cT“ 


(A3 .5) 


Since  the  limit  in  equation  (A3 .5)  exists  and  B  XB\  is  nonsingular  we  must  have 


£ 

* 


lim(2Tn  *  0 

y-*0  1 


R 

8 

8 

I 

I 


Therefore, 


UmTtCrGyC  *  \imT iHt BT QyBH 
*  Tt{Ht  limfl  \QilB  XH)  «=  0  , 

f-tO 


and  the  relations 


TtX m  Ti Q£Ct 

*  TiCr<?yC  , 
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XnMX Wy)  ^  TtXy 

imply  that  Kn*xWy)  — »  0  as  y  — »  0.  Therefore,  AfT  *  Yy 1  ->  «•  as  y  -»  0  which  com¬ 


pletes  the  proof  of  part  (a). 

The  proof  of  (b)  follows  directly  from  the  proof  of  Theorem  3.3. 

Q.E.D. 
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